Stabilization of unstable steady states by variable delay feedback control 
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We report on a dramatic improvement of the performance of the classical time-delayed autosyn- 
chronization method (TDAS) to control unstable steady states, by applying a time- varying delay in 
the TDAS control scheme in a form of a deterministic or stochastic delay-modulation in a fixed inter- 
val around a nominal value Tq. The successfulness of this variable delay feedback control (VDFC) is 
illustrated by a numerical control simulation of the Lorenz and Rossler systems using three different 
types of time-delay modulations: a sawtooth wave, a sine wave, and a uniform random distribution. 
We perform a comparative analysis between the VDFC method and the standard TDAS method 
for a sawtooth-wave modulation by analytically determining the domains of control for the generic 
case of an unstable fixed point of focus type. 

PACS numbers: 05.45.Gg, 02.30.Ks 



I. INTRODUCTION 

The idea of controlling chaos has been initiated by Ott, 
Grebogy and Yorke in a seminal paper proposing a rou- 
tine to stabilize unstable orbits embedded in chaotic at- 
tractors This control scheme, now recognized as the 
OGY method, is taking advantage of the ergodicity of 
the system by applying a small perturbation to a suit- 
ably chosen control parameter when the trajectory of the 
system is sufficiently close to the stable manifold of the 
local linear system. Since the OGY paper, the control of 
chaos has become a topic of broad interest among scien- 
tists, both theoretically and experimentally [2, 3,0,0. 
Although different control schemes were developed, most 
of them are relying on the general concept underlying 
OGY scheme - stabilizing an orbit embedded into the 
chaotic system. 

An alternative and very practical implementation of 
the OGY idea is the time-delayed autosynchronization 
(TDAS) introduced by Pyragas in 1992 [6|, |7|, [Sj. It is 
based on a continuous feedback applied in the form of a 
control force proportional to the difference of the current 
state of the system at time t and its counterpart at some 
instant t — T'm the past. If the delay time T is set equal 
to the period of the unstable periodic orbit (UPO) whose 
stabilization is required, the control signal vanishes when 
the system is on that orbit, so that the extracted orbit 
remains a solution of the equations describing the dy- 
namics of the original system. In this sense, the Pyragas 
method is non-invasive. 

A generalization of Pyragas method was suggested by 
Socolar, Sukow and Gauthier in 1994 [§, where the 
feedback signal was taken in the form of a geometric sum 
(extended time-delayed autosynchronization - ETDAS), 
or a mean value of a finite number of delay terms (N 
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time-delayed autosynchronization - NTDAS), each using 
information from many previous states of the system in- 
volving integer multiples of the delay time T. In spite 
of introducing an additional control parameter, ETDAS 
has been recognized as the most important modification 
of the TDAS, since it achieves stabilization of UPOs with 
a higher degree of instability. 

Parallel to the efforts of stabilizing UPOs, the Pyragas' 
method and its various extensions were used to stabilize 
unstable steady states (USS) [111,113,113,111,113. Among 
these is the multiple delay feedback control (MDFC) re- 
cently suggested by Albhorn and Parlitz [l^, [l3|. The 
scheme is a natural extension of ETDAS method, us- 
ing two or more delayed feedback signals with incom- 
mensurate delay times. Although being more effective in 
comparison to TDAS and ETDAS, the MDFC has some 
drawback by introducing additional control parameters 
with every additional feedback signal. 

To improve the performance of TDAS in controlling 
unstable steady states, with this paper we suggest a vari- 
able delay feedback control (VDFC), where the delay 
time T is not kept constant during the control process, 
but it is modulated in time in a suitably chosen way. 
We demonstrate the VDFC method for the paradigmatic 
Lorenz and Rossler systems, using three different types 
of modulation of the delay time T{t) around a nominal 
value To in a fixed interval [Tq — e, Tq -f e] determined 
by the control parameter e. To make a comparison with 
the TDAS method, we perform a linear stability anal- 
ysis of the VDFC for stabilizing a two-dimensional un- 
stable steady state of a focus type for different values of 
the parameter e. By using the same method of analysis, 
we calculated the parameter regions for successful VDFC 
stabilization of the unstable steady states in the three- 
dimensional Lorenz and Rossler systems. We show that 
for e = VDFC is reduced to TDAS, and for e > the 
domain of control is drastically enlarged with respect to 
TDAS. The correctness of the stability analysis is sup- 
ported by computer simulations. 
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FIG. 1: Schematic of the variable delay feedback control 



II. VARIABLE DELAY FEEDBACK CONTROL 

The Pyragas' method assumes a dynamical system 
having at least one scalar variable y{t) accessible for mea- 
surements, and an input channel through which the ex- 
ternal force F{t) is fed back to the system. The standard 
TDAS control scheme reads: 



where 



-x(t) = Q(2/(t),x(t)), 
j^y{t) = P{y{t),^{t)) + F{t), 



F{t)=K[y{t~T)-y{t)] 



(1) 
(2) 

(3) 



is the external feedback force which is reinjected into the 
system through the y-channel as the difference between 
the signal y{t) and the delayed signal y{t — T) multiplied 
by a constant weighting factor K. The remaining vari- 
ables of the system are represented by the vector x, and 
P and Q are nonlinear functions. The scheme involves 
only two control parameters - the delay time T and the 
control gain K . For an effective stabilization of USSs, 
the delay time T is related to the intrinsic characteristic 
timescale given by the imaginary part of the stationary 
point eigenvalue 

The external feedback force ([3]) in the case of VDFC 
reads: 



F{t)^K[y{t^T{t))-y{t)], 



(4) 
The 



where T{t) is the time-dependent delay time 
schematic of VDFC is shown in Fig. 1. 

To illustrate the VDFC method for stabilizing unstable 
steady states, we will use the Lorenz system [l8|: 



—x{t) = -lQx{t) 



l{)y{t), 



-yit) - 28xit)~y{t)^x{t)z{t)+F{t), 



d , , 



-S/Zz{t) + x{t)y{t), 



(5) 
(6) 
(7) 



assuming that the output variable is y{t) and that the ex- 
ternal feedback signal ^ perturbs only the second equa- 
tion of the system. The trajectory of the unperturbed 



system {K = 0) is shown in panel (a) of Fig. 2, where 
the appearance of the chaotic attractor becomes evident. 

The Lorenz system has three equilibrium points, one 
at the origin Cq (0,0,0), and two positioned symmetri- 
cally with respect to the z-axis at C+(6%/2,6V2,27) and 
C~(— 6\/2, — 6\/2, 27). Linearizing the Lorenz equations 
around the equilibrium points reveals the form of their 
stability. The eigenvalues of the unperturbed fixed point 
Co at the origin are A(Co) ~ {-22.83,11.83,-2.67} in- 
dicating an unstable three-dimensional saddle with one 
positive and two negative real eigenvalues. The other 
two fixed points have the same type of stability given by 
their common set of eigenvalues A(C^) « {—13.85, 0.09-1- 
10.19i,0.09 - 10.19i}. They are unstable fixed points of 
the focus type, having one negative real eigenvalue and 
complex-conjugate pair of eigenvalues with positive real 
part. 

Panels (b)~(g) of Fig. 2 depict the dynamics of the 
variable x{t) and the feedback signal F{t) obtained from 
a computer simulation of the VDFC-controUed Lorenz 
system (5)-(7), indicating a successful control of the fixed 
points by using three different types of modulation 
of the delay time T{t) in an e-neighbourhood around a 
fixed value Tq. The initial conditions of the system were 
chosen x(0) = 2, y(0) = 3 and z(0) = 4. The control 
was activated at i = 300. Panels (b)-(c) correspond to 
time-modulation in a form of a sawtooth wave with an 
inverse period a: 



T{t) = To + e[2(a<modl) - 1], 



(8) 



panels (d)--(e) represent the time-series for a uniform ran- 
dom distribution of the delay times T(t) in an interval 

[To-£,ro+e]: 



T{t) = To + £ Random [-1, 1], 



(9) 



and panels (f)-(g) are related to periodic sine- wave mod- 
ulation: 



T(t) = To + £ sin (at). 



(10) 



In each case, the control parameters were chosen as 
K — 0.5, Tq = 30 and e = 1, with a = 10 for the sawtooth 
and sine waves. We note that the values for the control 
parameter e are limited to the interval < £ < To. In 
panels (c), (e) and (g) we see that the feedback signal 
F{t) vanishes when the stabilization of the fixed point is 
achieved, suggesting noninvasiveness of VDFC. The non- 
invasiveness of the control method follows from the form 
of the control force in Eq. Q, since y{t — T{t)) = y{t) 
if the fixed point is stabilized. We notice that the sad- 
dle point Co at the origin cannot be stabilized with the 
VDFC scheme, obeying the odd-number limitation the- 
orem that a Pyragas-type control in its standard form is 
limited to fixed points characterized by a finite torsion, 
which do not have an odd number of positive real eigen- 
values [li,|23,|2ll,[23. The fixed points do not have 
positive real eigenvalues, and they can be stabilized with 
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FIG. 2: (Color online) A simulation of variable delay feedback control in the Lorenz system ©-([TI using three different 
modulations of the delay time, (a) The Lorenz attractor of the unperturbed system; (b),(c) The time-series of the variable x{t) 
and the feedback signal F{t) of the controlled system corresponding to a sawtooth-wave modulation with a = 10, indicating a 
successful control of the unstable fixed point at C^; (d),(e) The corresponding time-series for a uniform random modulation 
controlling the unstable point at C~; (f),(g) The time-series for a sine-wave modulation (a = 10), stabilizing the unstable point 
at C*". In each case, the initial conditions were: a;(0) = 2, j/(0) = 3 and z{0) = 4, the control parameters were: K = 0.5, 
To = 30 and e — 1, and the control was activated at t — 300. Note the difi'erent scales on the t-ajds on different panels. 



the proposed version of VDFC, as indicated in Fig. 2. 
Since the fixed points and C~ have identical eigen- 
values, the Lorenz system can be stabilized to either of 
these states, depending on the initial conditions. In the 
case of uniform random modulation ([9]) , the preference of 
control toward either C+ or will also depend on the 
random number sequence used in the modulation. In the 
latter case, we noticed that for identical initial conditions 
and different uniform random sequences, the preference 
of stabilization of the system varies between C+ and C~ . 
Also, keeping the random sequence fixed and varying the 
starting position of the sequence infiuences the prefer- 
ence of the control. These observations could be related 
to the structure of the basins of attraction for the stabi- 
lized steady states C^. 

The simulation was repeated for the Rossler system 

M- 

j^x{t) - -y(t)-z(t), (11) 

j^vit) - x{t)+Q.2y{t) + F{t), (12) 

^zit) = Q.2 +{xit)-h.7)z{t), (13) 
at 

with the feedback force F{t) as given in Eq. (|4|), using 
the same types of time modulation of the delay time T{t). 
The unperturbed Rossler system has two unstable fixed 
points of the focus type at Ci (0.007, —0.035, 0.035) and 
(72(5.693,-28.465,28.465) with corresponding eigenval- 
ues A(Ci) « {-5.687, 0.097 -f0.995i, 0.097 - 0.995i} and 
A(C2) ~ {0.192, -4.596 • 10"^^ -I- 5.428i, -4.596 • lO'^ - 
5.428i}. The stabilization has been achieved only for the 



fixed point Ci , since it doesn't possess positive real eigen- 
values, whereas the fixed point C2 has one, and therefore, 
cannot be stabilized with the present version of VDFC. 
We omit a detailed discussion on the stabilization process 
and the simulation figures describing the dynamics of the 
control, since they concur to the ones for the Lorenz sys- 
tem. 



III. THE MECHANISM OF VDFC 

To provide an insight into the mechanism of the VDFC 
method and to reveal its superiority over the classical 
TDAS, we will initially consider a two-dimensional non- 
linear system of first-order differential equations: 

|x(0=f[x(t)], (14) 

with x(t) = Gol[x{t),y{t)] being the state column vector 
of the system, and f the field vector describing the dy- 
namics of the system. The stability of a particular critical 
point X can be determined by linearizing the vector field 
f around x. We assume that the system (ITil) has under- 
gone a coordinate transformation, such that the critical 
point X is at the origin (x = 0). We also assume that the 
critical point x = is an unstable fixed point of focus 
type. Here we have taken into account the limitation of 
the original Pyragas scheme, suggesting a failure of the 
control method for a torsion-free situation, i. e. if the 
number of positive real eigenvalues of the unstable fixed 
point is odd. The linearized version of the system (I14p 



4 



in center manifold coordinates can be written as: 



-x(i) = Ax(0, 



where 



A 



A LO 

—uj A 



(15) 



(16) 



is the matrix that determines the dynamics of the un- 
perturbed system. The matrix A has complex conjugate 
eigenvalues Aq — Aiiw, with A and uj positive real num- 
bers, warranting an unstable focus at the origin. 

To stabilize the unstable fixed point at the origin us- 
ing VDFC, we will perturb the system lfT4|) with an ad- 
ditional control force F(i) in the diagonal form: 



F(i) = K 



x{t-T{t))- x{t) 
y{t-T{t))-y{t) 



(17) 



where K is the feedback strength, and T{t) is the time- 
dependent delay time. The linearized system (jl5[) now 
obtains the form: 



-x(t) =Ax(t)+F(t), 



(18) 



which, in the case when T{t) is constant, reduces itself to 
the standard diagonal TDAS control scheme. In the fol- 
lowing, we consider a modulated time-delay T{t) around 
a nominal value To, in a form of a periodic sawtooth 
wave (jS]). In this case, the delay time T{t) is uniformly 
distributed over the interval [Tq — e, Tq -I- e]. According 
to Michiels-Van Assche-Niculescu (MAN) theorem 24], 
the stability of under the variable-delay control force 
P?)) can be inferred from the stability of the analogous 
time-invariant system with a distributed delay: 



dt 



x{t) = Ax(i) -i-r(i). 



(19) 



having a control force F(t) in the form: 



/ 1 rt-To+s \ 

— / x{9)d9~x{t) * 

2£ Jt-Ta-e 



Y{t) = K 



\ 2^ 



t-To+e 



t-To-e 



y{e)de-y{t) 



(20) 



The theorem asserts that if the comparison system (jlOp - 
(pO)l is asymptotically stable, then the original system 
(fT7l) - p8|l is globally uniformly asymptotically stable for 
sufficiently large values of the inverse period a of the 
modulation. We note that in the case of a non-uniform 
deterministic distribution of T{t) in the interval [Tq — 
e, Tq -|- e], an additional multiplicative factor will appear 
in the integrals in Eq. (I^Dl) depending on the form of 
T(t), due to the non-constant weight of the distribution. 



Using the ansatz x(i) ^ exp(At) in Eq. (fT9l) . we obtain 
the characteristic equation for the eigenvalues A of the 
comparison system (fT9| - (|20|) : 



A ± = A 



1 - 



sin^Ae) ^_ATo 
Ae 



(21) 



Af+A - X±iuj+K (e[A(t-J^(*))-A(t))]t-A(t-T(t))T(t) 



Under the conditions of the MAN theorem, the stabil- 
ity of the original system pTjl - pS]) is determined by the 
roots A of the characteristic equation (PT|) , providing that 
the frequency a of variation of the delay is large com- 
pared to the system's dynamics. In this sense, the roots 
A may be considered as effective eigenvalues describing 
the overall stability of the original variable-delay system. 

The presence of the parameters e and Tq determining 
the delay interval makes the characteristic equation ((2T|) 
transcendental in A, possessing countable infinite set of 
complex solutions. The control is successful if for some 
e, K and Tq the real parts of all the eigenvalues A are 
negative. 

An alternative heuristic way to arrive to Eq. (PT]) is 
the following. We shall look for a solution of Eq. (fT8|) in 
the form x(t) ~ exp(A(t)t). The equation for K{t) is 

■0- 

(22) 

Considering the asymptotic domain (and therefore 

t ^ T{t)), the finite variation of the delay-time T{t) and 
the approximation A{t - T{t)) - A{t) « -A{t)T{t), from 
Eq. (I22|) . one can conclude that there is an asymptotic re- 
lationship A(t) ^ 1/t, implying that asymptotically A(t) 
becomes a constant. Integrating (22) over a period of 
the time delay function T{t) in the asymptotic domain 
of large t results in Eq. (PT|) . 

We numerically analyze Eq. (pij) to obtain the domains 
of stability of the fixed point in the parameter plane K — 
Tq for different values of e, keeping the parameters of 
the unstable focus fixed at A = 0.5 and uj ~ tt. The 
results are shown in panels (a) through (d) of Fig. 3, 
corresponding to £ = 0, 0.3, 0.5 and 1 respectively. 

The shaded areas correspond to the set of control pa- 
rameters {K, Tq) for which the largest real part of the 
complex eigenvalues A is negative, indicating a success- 
ful control. For combinations {K,To) belonging to the 
white area, max[Re(A)] > 0, and the control is not possi- 
ble. The values of max[Re(A)] are given by the grayscale 
in the upper right corner of Fig. 3. The control be- 
comes more robust for larger magnitude of the negative 
max[Re(A)]. When e — 0, the VDFC method reduces to 
the standard TDAS control method, and the domain of 
successful control is indicated in panel (a) of Fig. 3 [l]|. 
As e becomes larger than zero and closer to 1 (panels 
(b) through (d)), the domain of control is drastically en- 
larged, reaching its maximum at e = 1 (panel (d)). We 
note that due to the limitation of the control parameter 
e to the interval < e < Tq, the origin of the axis Tq is 
taken at Tq — s. 

In panels (e) through (h) of Fig. (3) we show the sta- 
bility regions corresponding to panels (a) through (d). 
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FIG. 3: (Color online) (a)-(d) Domains of control in the {K,Tq) plane for a sawtooth-wave modulation of the delay time, 
obtained by a numerical solution of the characteristic equation (|21|) . The values of the modulation amplitude are: (a) e = 0, 
(b) e = 0.3, (c) e — 0.5, (d) e = 1. For combinations of K and To belonging to the shaded areas, the largest real part of the 
complex eigenvalues A is negative, and the control is successful. The parameters of the unstable focus are A = 0.5 and lj = vr. 
(e)-(h) The corresponding stability regions (black areas) determined by a computer simulation of VDFC for the system (|18|) . 
Note the shifts of the origin along the To-axis by an amount equal to e. 



obtained by a computer simulation of the VDFC control 
scheme (|18p . The simulation is performed by picking a 
point from the parameter plane K — Tq and numerically 
integrating the system (HH]). The time- modulation oiT{t) 
used in the simulation was in a form of a sawtooth wave 
([5]) with an inverse period a = 10. The combinations 
{K,To) that lead to a successful fixed point stabilization 
are marked in black. We immediately notice an excellent 
resemblance between the stability domains obtained by 
computer simulation and by numerically analyzing the 
characteristic equation (PT|) . The resemblance may be 
further improved by requiring a larger accuracy of the 
Runge-Kutta method used in the simulation. 

To obtain an analytical description of the boundaries 



of the control domain in Fig. 3, we substitute A = H -|- 
i n into the characteristic equation ((2T|) and separate the 
equation into real and imaginary parts. Since 11 = 
at the threshold of control, the resulting equations are 
reduced to: 



A 



K 1 



sin (fie) 



cos (nTo) 



±oj = + sin(»ro). 



(23) 
(24) 



which can be algebraically manipulated to obtain a para- 
metric representation of the dependence on of the 
boundary of the successful control domain 



J 



Kin) = 



X±y/X^-{1- [sin {ne)/{ne)]^}[X^ + (cu - Q)^] 



1 

n 
1 



1 - [sin {ne)/{ne) 



2mT + arccos 



2{n + l)7r — arccos 



A[sin (17e)/(f]£)]2±^A2-{l- 


[sin {ne)/{ne] 


P}[A2- 




[sm{ne)/{ne)] 




[sin {ns)/{ne) 


P}[AM 


- {UJ - f7)2] 





A[sin {ne)/{ne)f ± ^X^ - {1 - [sin (Oe)/(f7e)]2}[A2 + (cj - nf] 



sin{ne)/{ne)] X±^X^-{1- [sin [ne) / {ne)Y}[X^ + - nf 



(25) 
(26) 

,(27) 
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where n is a nonnegative integer characterizing different 
leaves arising from the multivaluedness of the arccosinc 
function. 

When £ = [see panels (a) and (e) in Fig. 3], VDFC 
is reduced to TDAS, and Eqs. ^ and ^ read jlj]: 



A = K (1- cosiilTo)) . 
±LU = n + Ksm{nTo). 



(28) 
(29) 



In this case, when the product fiTg is an odd multiple 
of vr, we obtain Q = lo and K = K^in = A/2. Hence, 
the points K — Kmin — A/2 and Tq — {2n + 1)tt/u! 
correspond to points of successful control in the K ~ Tq 
plane with minimal feedback gain. Similarly, when QTq 
is an even multiple of tt, that is, when Tq = 2m:/Lu, the 
control fails for any feedback gain. The domain of control 
consists of stability islands at Tq corresponding to odd 
n isolated by regions encompassing Tq corresponding to 
even n for which the control fails. 

When £ > [panels (b)-(d) and (f)-(h) in Fig. 3], 
from Eqs. ([23]) and ([24]) we obtain: 



A 



1 + sin {uje)/{uje) 



for QTq = {2n + l)7r, and: 



1 



(30) 



(31) 



for ^ITq = 2n7r, implying considerable reconfiguration of 
the stability islands as soon as £ > 0, which is readily 
observable from Fig. 3. Specifically, if £ = 1 and a; = tt, 
then Kmin = A for any integer Tq, as is clearly indicated 
from panels (d) and (h) in Fig. 3. 

To conclude this section, we numerically calculated the 
parameter regions of the effective fixed point control for 
the Lorenz system ©-([T]) and the Rossler system (|lip - 
(|13p in the case of a periodic sawtooth-wave modulation 
([5]). The calculations were performed for different values 
of the modulation amplitude £, following the same strat- 
egy as for the two-dimensional case discussed previously. 
We omit showing the resulting characteristic equations 



and the parametric formulas describing the boundary of 
the domain of control due to their length and complexity. 
The obtained stability regions are depicted in Fig. (4). 



IV. CONCLUSION 

We have demonstrated that implementation of a time- 
varying delay into the standard TDAS control scheme 
can dramatically improve the efficiency of control of un- 
stable steady states. The method of variable delay feed- 
back control (VDFC) was illustrated for the paradigmatic 
Lorenz and Rossler systems, showing the usual control 
failure of TDAS in the case of unstable steady states 
having an odd-number of positive real eigenvalues. We 
expect that this limitation may be prevailed by a suitable 
choice of the feedback control matrix K [22, 25, 26l|, or 
by using the VDFC method in combination with more 
sophisticated control schemes [13, H^l . 



Using Michiels-Van Assche-Niculescu theorem [2J| and 
an independent approach for the case of a time-varying 
delay in a form of a sawtooth- wave, we were able to per- 
form a linear stability analysis to calculate the domain of 
control for a two-dimensional unstable focus in the plane 
parametrized by the feedback gain K and the nominal 
time-delay Tq for different values of the parameter e de- 
termining the amplitude of the modulation. The same 
analysis was repeated for the three-dimensional Lorenz 
and Rossler systems. In parallel to the analytic deriva- 
tion, we performed computer simulations that confirmed 
the results of the analytical approach. In this way, we 
showed that variable delay feedback control allows sta- 
bilization of unstable steady states over much larger do- 
main of parameters in comparison to the usual TDAS 
control scheme. 

Various modifications and extensions of the VDFC 
method, like using different forms of delay modulations, 
including a variable time-delay into the ETDAS scheme 
and other schemes, the influence of the nonzero control- 
loop latency bandpass filtering and non-diagonal 
coupling, as well as experimental implementation of the 
VDFC, are all subjects of ongoing analysis. 
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